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ABSTRACT 



An indirect measurement o£ mental effort in interpreting an 
aircraft instrument was made using changes in pupil diameter and the 
latency of dilation as measures. Significance was found in latency of 
dilation across levels of interpretation difficulty , vdaile no significance 
was found for percent changes in pupil diameter. 

Results also showed a moving base-line pupil diameter for all 
subjects across trials suggesting arousal decrement for the first 
half of the experiment, with a lesser effect for the latter half of the 
experiment. 
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I. INTRODUCTION 



Although pupillary variations evoked by emotional state and mental 
activity have been observed and commented on for at least two hundred 
years , large-scale scientific investigation of the phenomenon did not be- 
gin until the work of Hess and Polt (1960). Since that time , a rash of 
work has been done in an attempt to define the dimensions of the phenom- 
enon. 

The physiology of the eye and the visual processing system is , 
needlessly to say, an exceedingly complex and, as yet, largely unexplored 
area. Adler (1970) describes the visual pathway in terms of a three part 
chain lining the eye to the visual centers in the occipital cortex. The first 
two links are contained within the retina itself, beginning with the bipolar 
cells whose dendrites connect with the photoreceptors and vdiose axons 
synapse mth the dendrites of the ganglion which compose the second link. 
This second neuron then connects with the last link , the lateral geniculate 
body (LGB). The visual messages are then transmitted to the cortex. Al- 
though the LGB can be viewed as merely a way station , there is evidence 
to indicate that some additional inhibitory activity reaches the LGB from 
the cortex that results in a modification of the retinal impulses ; that is , 
the LGB adds its own counterpart to the messages it receives from the 
retina and transmits this in altered form to the cortex. 



6 



Adler (1970) further notes that in man, all of the visual fibers ter- 
minate in the striate area (area 17) located in the occipital cortex. This 
is the primary visual cortical area. The impulses received by this area 
enables one only to see , that is , perceive form and color. Other parts 
of the brain perform the tasks of converting this information into con- 
scious vision. Closely connected to area 17 are two secondary areas sur- 
rounding the primary visual area: the paras triate area (area 18) and the 
pre-striate area (area 19). Area 18 is concerned with the recognition of 
objects , while area 19 is concerned with the recall of visual objects. The 
function and location of both of these areas are, however, in dispute a- 
mong investigators. These three areas are very well illustrated on page 
296 of Wright (1966). 

A fourth cortical area , the angular gyrus , functions as the storage 
area for the recognition and recall of visual speech and the memory pat- 
tern of symbols of written or printed language. That is , it provides an 
interpretative function for symbols. The major angular gyrus is closely 
associated with area 19. 

The iris is controlled by two sets of muscles , the sphincter and 
dilator. The current theory of their function is centered around the 
phenomenon of reciprocal innervation. Dilation is dependent on contraction 
of the dilator and relaxation of the sphincter. These muscles are inner- 
vated by the autonomic nervous system. The parasympathetic (involuntary) 
division of this system controls pupil size as a function of light intensities 
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and accommodation. The role of the sympathetic division in controlling 
pupil size is not as clear, however. The afferent pathway from the cortical 
center to the iris is , at present , in doubt , although the centers for the 
origin of pupillary dilator impulses are located in the hypothalamus. 

The pupils are in a constant state of change , depending upon the 
changing balance between the tonus of the sphincter and dilator muscles. 
Because so many factors influence this balance , it is extremely difficult 
to isolate one from another. The various factors that influence the state 
of the pupils may be divided into two rough categories: (1) responses 
determined by light variations (light reflex) and accommodation, and (2) 
responses to sensory stimulation. It is the latter case that is of para- 
mount interest in the experiment described in this paper. 

Most of the experimental work that has been done since the pioneer- 
ing efforts of Hess and Polt (1960) can be separated into two major 
categories: those that have dealt with cognitive demand, and those 
centered around attitude and preference. Barlow (1969) , in his review of 
pupillometric literature noted that the former showed consistent results , 
while the latter yielded (as might be expected) ambiguous results. Since 
the present experiment properly belongs in the first category , a shorf 
resume of cognitive demand experiments would be in order. 

Hess and Polt (1964) , in an experiment involving multipHcation prob- 
lems, found that the diameter of the pupil increased with the difficulty 

of the problem. They concluded that pupil response in this situation was 
a direct reflection of neurological activity. 
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In a replication of this experiment, Hope (1971) substantiated the 
correlation of an increase in pupil diameter for correctly answered prob- 
lems but found an associated decrease in pupil diameter for incorrect 
replies. He also found that \\^en a subject made a correct response, the 
maximum dilation reached was maintained , while for an incorrect response , 
the diameter decreased after reaching a maximum and continued to decline 
through the base-line diameter into the constriction region. He inter- 
preted this as a manifestation of cortical "overload," that is, a blocking 
out of the stimuli. 

Kahneman and Beatty (1966) compared pupillary response in a short- 
term memory task with that of a long-term memory task. They found 
that the peak diameter reached during the report phase of the long-term 
task was consistently greater than 6r the short-term task. They con- 
cluded that an obvious mental effort was exerted by the subjects in re- 
sponse to the cue , and that apparently this effort is at a maximum 
shortly after the cue. They cautioned, however, that retrieval of 
information from long-term memory may not invariably elicit a greater 
pupillary response than short-term memory and recall. 

Kahneman and Beatty (1967) conducted an audio-tonal discrimination 
experiment in which the subjects compared two tones and then were re- 
quired to decide whether the comparison tone was higher or lower than 
the standard tone. They found that the magnitude of dilation increased 
with the difficulty of the discrimination task. 
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Pcdvio and Simpson (1968) conducted an experiment to investigate 
the effect on pupil diameter when an overt response indicating task ful- 
fillment was required. They found that greater dilation occurred only 
in those conditions in which an overt response was required; in this case 
pressing a key and/or verbalizing a response. They concluded that pupil- 
lary dilation is enhanced when an overt motor response is required. This 
finding substantiated the findings of others (Simpson & Paivio, 1966; 
Hakerem & Sutton, 1966). 

II. BACKGROUND AND PURPOSE OF THE EXPERIMENT 

When an aviator flies under instrument conditions , his primary 
reference instrument is the Vertical Gyro Indicator (VGI). This device 
is essentially a gyroscope aligned with the earth's surface before take-off. 
The VGI informs the pilot of the aircraft's pitch attitude (level, climb- 
ing or diving) and roll attitude (left or right wing down, or wings level). 

It is not at all uncommon during flight for the pilot to be distracted 
from his flight instmaments to make radio frequency changes, etc. , and, 
upon re-scanning the flight instruments , find that the aircraft has entered 
into an "unusual attitude," that is, an attitude not consciously directed 
by the pilot. The pilot must then interpret what attitude the aircraft 
is in and apply the proper recovery procedure. This dual task becomes 
critically important when flying at low altitudes , such as making an 
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instrument approach, when, interestingly enough, the distractions are 
most numerous. 

Thus it is apparent that the first task, that of correct VGI inter- 
pretation , is the key factor in a safe recovery. The experiment conducted 
was designed to simulate, in part, the VGI display encountered in an 
"xmusual attitude. " The purpose of the experiment was to investigate 
the pupillary activity prompted by the mental activity associated with the 
interpretation of the VGI displays. 

III. EXPERIMENTAL PROCEDURE 
A. APPARATUS 

Measurements of pupil diameter were taken and recorded by a Space 
Sciences Model 831D television pupillometer. This device is basically a 
closed circuit television system employing a signal processor to measure 
and display pupil diameter. A chart recorder integral to the unit provides 
a continuous , real-time record of the pupil diameter (see Fig. 4). 

The subjects were seated at the end of a table with their chin and 
forehead resting in an adjustable frame. The TV camera was focused on 
the left eye. Illumination of the eye was provided by a near-infra-red, 
low-intensity light source attached to the side of the camera mount. 

The stimuli used in the experiment were black-and-white slides 
which were rear projected on a screen 36 inches from the subjects' eyes 
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by a KODAK Ektagraphic Model B-2 slide projector. The height o£ the 
center o£ the projected slides was adjusted to the level o£ each subject's 
eyes. 

The experiment was performed in one end o£ a windowless room using 
black-out curtains to achieve a semi-darkened condition. 

The slides used as test stimuli were photographs o£ the £ace o£ a 
VGI removed £rom the instrument panel o£ an instrument £light simulator 
(Link Trainer). The VGI was positioned to portray ten di££erent £light 
attitudes (See App. A and Figs. 6 and 7), Six o£ the ten attitudes were 
in the inverted position, since they were hypothesized to be the most 
di££icult to interpret, hence, evoke the greatest response. 

Be£ore and a£ter each stimulus slide , a control slide with the numeral 
5 in the center was projected on the screen £or the subject to £ocus on. 
This slide served to elicit a base-line pupil diameter £rom which measure- 
ments o£ changes in diameter could be made -when the stimulus slide was 
projected. 

The slides were care£ully controlled £or equality in brightness and 
contrast to minimize the light reflex e££ect. Measurements o£ luminance 
were taken using a light meter to insure that both control slides and 
stimulus slides were o£ the same luminance , as £ar as possible. The light 
meter readings ranged £rom £3. 9 to £2. 9. 

To provide a means o£ accurately event-marking the graph , the switch 
initiating slide changes was connected to the EVENT MARKER channel 
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o£ the pupillometer. The subjects were also provided a switch which event- 
marked the graph when they were ready to verbalize their interpretation 
o£ the stimulus slide. 

All experimental trials were conducted at the Naval Postgraduate 
School Human Engineering Laboratory, Monterey, California. 

B. SUBJECTS 

Twenty-one volunteer male military officers assigned to the Naval 
Postgraduate School were originally tested. However, due to difficulties 
associated with the pupillometer, the data for seven of the subjects was 
judged to be too unreliable to be useful. These problems will be discussed 
later. The remainder of this paper will, then, be based on the remaining 
fourteen subjects. 

All the subjects tested were experienced Naval Aviators from both 
the Navy and the Marine Corps , enrolled as graduate students at the 
Naval Postgraduate School. Their average age was 29. The average 
niunber of years of designation as an aviator was six years. Their aver- 
age total fli^t time was 1700 hours, ranging from 850 hours to 5000 
hours. 

Experienced pilots were selected for this experiment because of 
their famiHarity with the function of the VGI as a result of their train- 
ing and experience , thus minimizing a learning effect. 

Of the fourteen subjects, half were helicopter, transport, or 
patrol pilots, while the remainder were fighter and attack pilots. For 
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the purposes o£ later analysis , the two groups were labeled Group A and 
Group B respectively. This division was not arbitrary. Transport , patrol , 
and helicopter pilots seldom, i£ ever, encounter unusual £li^t attitudes, 
particularly inverted attitudes , while tighter and attack pilots do. It 
was hypothesized that there should be a significant difference in pupillary 
response as a result. 

C. METHOD 

Prior to the experiment, each subject was given a brief explanation 
of the equipment and the purpose of the equipment to put the subject at 
ease and remove some of the mystery of the equipment. The experimenter 
then formally read the instructions to subjects (App. D). 

After the subject was seated, the chin rest was adjusted so that the 
head was level but comfortable. The subject was then instructed to focus 
on the numeral 5 projected on the screen while the camera and pupillometer 
were adjusted. Two practice trials were then conducted to familiarize 
the subject with the procedure and display. 

The experiment began by having the subject focus on the numeral 5 
on the control slide. The experimenter monitored the pupillary diameter 
until a reasonably steady diameter was apparent, then initiated a stimulus 
slide. As soon as the subject analyzed the attitude represented, he 
pressed the switch he held in his right hand and verbalized the response. 

The stimulus sHde remained on the screen during the verbalization. 
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The experimenter event-marked the graph when the subject finished the 
verbalization and recorded the response. The experimenter then initiated 
a control slide , beginning the next trial. The subject was not informed of 
the correctness of his response. 

The slide order was randomized for each subject. 

D. MEASUREMENTS 

Three measurements were taken from the graph for analysis. 

(1) Latency of Dilation (LD); the time (sec. ) from slide initiation 
to maximiun dilation. 

(2) Base-line Diameter (d^^): the pupil diameter prior to initiation 
of a stimuli slide (usually the 3-4 sec. period prior to initiation). 

(3) Maximum diameter (dj^): the maximum pupil diameter reached 
during the interpretation of the stimuli slide. 

The scores for pupil diameter changes were calculated as percent- 
ages: 



— X 100 = percent pupil diameter change. 

^b 
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IV. DISCUSSION AND RESULTS 



The pupil reached itiaximxum dilation an average o£ 0. 8 seconds before 
the subjects pressed the MARK EVENT button and began verbalizing their 
analysis of the stimulus. This was of interest since it was anticipated 
that maximum dilation would occur at the moment of event-marking. Since 
the subject's chin, and consequently his head, would move vihile talking, 
the eye moved out of optimum camera focus. The chart output for the 
verbalization phase was ignored as a consequence. After verbalization , 
the diameter typically had returned to the base-line value. 

Since the slide projector required 1. 0 second to complete a slide 
change , a momentary light reflex occurred. This reflex was very notice- 
able on the graph. Since the pupil di^^meter typically returned to the base- 
line level very shortly after completion of the change , and then began a 
steady increase to a maximum diameter , the slide changing appeared to 
have no appreciable confounding effect. Thus , the precaution of insuring 
equal liuninance of control slides and stimuli slides as recommended by 
Woodmansee (1966) was vindicated. 

The analysis of variance of the two measures. Table I, shows that 
no significance was found for the percent pupil diameter change (PPDC), 
while the latency of dilation (LD) shows significance for the slides (VGI 
displays) main effect. To investigate this significance further, the mean 
LD was plotted with the slides ranked according to increasing mean LD of 
all subjects (Fig. 1). 
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TABLE I. 

I I 

ANALYSIS OF VARIANCE SUMMARY TABLE 
Percent Pupil Diameter Change (PPDC) 



Between Subjects 


d£ 


MS 


F 


P 


Pilot Group (G) 


1 


196. 59 


0.30 


(NS) 


Error 


12 


654.64 






Within Subjects 










SHdes (S) 


9 


90.22 


0.59 


(NS) 


S X G 


9 


114. 20 


0.75 


(NS) 


Error 


108 


151.71 






Total 


139 










Latency of Dilation (LD) 






Between Subjects 


df 


MS 


F 


P 


Pilot Groups (G) 


1 


19.61 


2.17 


(NS) 


Error 


12 


9.02 






Within Subjects 










SHdes (S) 


9 


4.67 


4. 31 


.0001 


S X G 


9 


1.75 


1.61 


(NS) 


Error 


108 


1.08 






Total 


139 









(NS = not significant p>.05) 
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It was noted that the inverted VGI displays appeared to evoke a greater 
mean LD than the upright VGI displays. For PPDC note (Fig. 2) that no 
clear pattern emerges from the responses. 

The mean LD for the inverted VGI displays was 3. 40 seconds , while 
the mean LD for the upright VGI displays was 2. 57 seconds. The null 
hypothesis that the means are equal could be rejected at the . 01 level 
(t=3.46, df=138). Using PPDC as the measure, the mean PPDC for the 
upright VGI displays was 10. 47 and for the inverted VGI displays was 9. 33. 
The null hypothesis of equality of the means could not be rejected 
(t=0.48, df=138). 

Each group was then examined separately to determine if there was 
a significant difference in response between the inverted and upright VGI 
displays. Using LD as the measure, both groups demonstrated a significant 
difference: 

Group A : inverted mean = 3. 85 

upright mean = 2. 82 

Reject Hq : means are equal at .01 level (t=2. 51, df=68) 

Group B : inverted mean = 2. 94 

upright mean = 2. 32 

Reject Hq at .05 level (t=2.58, df=68) 

Using PPDC as the measure , neither group demonstrated a significant 
difference in means: 
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feSfl 





Group A : inverted mean = 11.06 

uprigjit mean = 10.85 
Cannot reject Hq (t=0.06, d£=68) 

Group B: inverted mean = 7. 61 

upright mean = 10. 09 
Cannot reject Hq (t=0.79, d£=68) 

Disagreement between the two measures was also found when the 
data was tested to determine if there was a difference in the responses 
of the two groups for (1) the upright VGI displays , and (2) the inverted 
VGI displays. Using LD as the measure, the following results were 
obtained: 

Upright VGI Displays : Group A mean = 2.82 

Group B mean = 2. 32 

Can reject Hq: means are equal at .01 level (t=2.78, df=54) 

Inverted VGI Displays ; Group A mean = 3. 85) 

Group B mean = 2. 94 

Can reject Hq at .01 level (t=2. 53, df=82) 

Using PPDC as the measure , the following results were obtained: 

Upright VGI Displays : Group A mean = 10. 85 

Group B mean = 10.09 

Cannot reject Hq (t=0.18, df=54) 

Inverted VGI Displays : Group A mean = 11.06 

Group B mean = 7. 61 
Cannot reject Hq (t=l. 28, df=82, p . 20) 
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Paivio and Simpson (1968) suggested that the latency of dilation, 
i.e. , the time&am presentation of the stimulus until maximium pupil 
dilation is reached, may be a more sensitive indicator of mental effort 
than pupil diameter increase. This was substantiated by Colman and 
Paivio (1969). They also demonstrated that dilation during a cognitive 
task is enhanced vdien the subject is required to make an overt response 
indicating task fulfillment. It can thus be reasonably contended that if 
pupil diameter change had been significant in the present experiment, 
some doubts could have been raised about the validity of that significance. 
The fact tdiat pupil diameter increase was not significant but the latency 
of dilation was, tends to support Simpson and Paivio's contention (1968) 
that latency of dilation is , in fact , a more sensitive indicator of the 
processing effort. 

Woodmansee (1966) recommended that pupillometric experimenters 
check for arousal decrement of subjects across trials. This arousal 
decrement, he noted, can occur as the result of boredom, fatigue or 
adaptation. In the present experiment , this was eliminated (as recom- 
mended by Pratt (1969)) by using, as the dilation score, the percent 
change of diameter from control slide (d]^) to maximum diameter occurring 
during stimulus slide presentation (d^^). Fig. 3 is a plot of the percent 
of change of the base-line diameter across trials with trial 1 as the base 
figure. Note that most of the decrease occurred during the initial trials 
of the experiment. This appears to indicate that the subjects were 
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highly excited at the beginning o£ the experiment due to the newness o£ 
the experiment which even the instructions , demonstrations , and two 
practice trials could not eliminate. A£ter viewing a £ew o£ the early 
slides , the subjects had apparently adjusted to the experiment and 
£uxther changes were more gradual. 

During the experiment , two major procedural problems with the 
pupillometer arose which merit discussion and hope£ully may aid other 
experimenters in their research e££orts using the same instrument. 

It was observed on a number o£ occasions that obtaining an optimal 
crescent and black line on the TV monitor was almost impossible in spite 
o£ adjusting the camera viewing angle, the £-stop, and the light source. 
This was particularly true with subjects with light colored irises. Subjects 
with dark irises presented almost no problem. 

Subjects with long eyelashes or eyelashes that partially covered the 
iris prohibited obtaining accurate pupil measurement. The solution to 
this problem is a modification o£ the camera mount so that the camera 
can be tilted up slightly. 
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Latency of Dilation (Sec. ) 



Note: Slides 1-4 are upright VGI displays 

Slides 5-10 are inverted VGI displays 



All Subjects 

Group A Pilots (Transport/Helo/Patrol) 

Group B Pilots (Fighter/ Attack) 




12 3456789 10 

Slide Number 

FIGURE 1. LATENCY OF DILATION (LD) 
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Percent Pupil Diameter Change 



Note: Slides 1-4 are upright VGI displays 

Slides 5-10 are inverted VGI displays 




Slide Number 

FIGURE 2. PERCENT PUPIL DIAMETER CHANGE (PPDC) 
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APPENDIX A 



SIMULATED AIRCRAFT ATTITUDES USED AS STIMULI 



Upright/ 

Slide Number Wing Position Nose Position Inverted 



1 


Level 


Up 


Upright 
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Rt. Wing Down 


Level 


Upright 


3 


Lt. Wing Down 


Level 


Upright 


4 


Rt. Wing Down 


UP 


Upright 


5 


Level 


Up 


Inverted 


6 


Lt. Wing Down 


Up 


Inverted 


7 


Rt. Wing Down 


Level 


Inverted 


8 


Rt. Wing Down 


Up 


Inverted 


9 


Rt. Wing Down 


Down 


Inverted 


10 


Lt. Wing Down 


Down 


Inverted 
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TABLE II. PERCENT PUPIL DIAMETER CHANGE 
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TABLE III. LATENCY OF DILATION 
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TABLE IV. BASE-LINE DIAMETER PERCENTAGE CHANGE 
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APPENDIX C 



FIGURES 
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FIGURE 5. THE PUPILLOMETER AS SET UP WITH THE 
SLIDE PROJECTOR AND SCREEN 
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FIGURE 6. THE VERTICAL GYRO INDICATOR (VGI) 
IN THE UPRIGHT, NOSE UP, 

LEFT WING DOWN POSITION 
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FIGURE 7. THE VERTICAL GYRO INDICATOR (VGI) 
IN THE INVERTED, NOSE DOWN, 

RIGHT WING DOWN POSITION 
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APPENDIX D 



INSTRUCTIONS FOR SUBTECTS 

TfflS IS AN EXPERIMENT TO TEST EYE RESPONSE TO VISUAL 
STIMULI. YOU WILL BE SEATED AT THE END OF THE TABLE WITH 
YOUR CHIN AND FOREHEAD RESTING IN THE FRAME. WHEN YOU ARE 
READY, A SLIDE OF A VGI WILL BE PROJECTED ON THE SCREEN. 

WHEN YOU HAVE ANALYZED THE VGI; THAT IS, DETERMINED THE 
ATTITUDE OF THE SIMULATED AIRCRAFT , PRESS THE BUTTON YOU 
HOLD IN YOUR HAND. THEN VERBALLY DESCRIBE THE AIRCRAFT 
ATTITUDE IN THE FOLLOWING TERMS: 

(1) NOSE UP/DOWN/LEVEL 

(2) INVERTED/UPRIGHT 

(3) LEFT WING DOWN/RIGHT WING DOWN/WINGS LEVEL 
THE ORDER IN WHICH YOU VERBALIZE THESE IS NOT IMPORTANT— 
BUT PLEASE STATE ALL THE DESCRIPTORS. 

AFTER VERBALIZING THE RESPONSE , A FOCUSING SLIDE WITH 
THE NUMBER 5 IN THE CENTER WILL APPEAR. PLEASE FOCUS ON 
THE NUMBER. THE NEXT SLIDE WILL THEN BE PRESENTED. 

THE PUPILLOMETER IS VERY SENSITIVE TO HEAD MOVEMENTS, 
SO PLEASE DO NOT MOVE YOUR HEAD DURING THE COURSE OF THE 
EXPERIMENT. 

WE VJILL NOW RUN THROUGH A TEST TRIAL OF THE EXPERIMENT 
TO FAMILIARIZE YOU WITH THE PROCEDURE AND THE DISPLAY. 

ANY QUESTIONS? 
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